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Abstract 

In the lattice Boltzmann equation, continuous particle velocity space is replaced by a finite 
dimensional discrete set. The number of linearly independent velocity moments in a lattice Boltz- 
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discrete velocity set, it is important to know to exactly what order moments are free of these de- 
pendencies. Elementary group theory is applied to the solution of this problem. It is found that by 
decomposing the velocity set into subsets that transform among themselves under an appropriate 
symmetry group, it becomes relatively straightforward to assess the behavior of moments in the 
theory. The construction of some standard two- and three-dimensional models is reviewed from 
this viewpoint, and procedures for constructing some new higher dimensional models are suggested. 
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I. INTRODUCTION 


A guiding principle of this series of papers is the formulation of the lattice Boltzmann 
equation (LBE) as a discrete kinetic theory [1-10] . In kinetic theory, moments of the distri- 
bution function /( x, t) over the space of velocities $, are tensors of various ranks [11, 12] 

that define continuum fluid properties including mass, momentum, energy, stress, and heat 
flux. Analogous moments can be formed over a finite velocity space in the discrete setting 
of the lattice Boltzmann equation; however, discreteness permits degeneracies that do not 
exist in the continuous case [13]. 

Thus, in kinetic theory, the number of linearly independent components of the general 
moment of order n, 

M(*, t) = J d£ /(*, £, t) (1) 

n times 

is equal to the number of linearly independent products £ • • • £ in the integrand, namely 
(n + l)(n + 2)/2 in three-dimensional configuration space, and (n + 1) in two dimensions. 
But in a discrete kinetic theory, in which the integral over continuous velocity space $, in 
Eq. (1) is replaced by a sum over a finite velocity set C with N elements, 

M(®, t) = 'Ecr^fix, Q, t) = Cjj— c^fi(x, t ) (2) 

V C C n times CjSC n tj me s 

the factor fi(x, t ) := f(x, Cj , t) restricts the number of linearly independent components to 
at most N. Therefore, if iV < (n + 1) (n + 2)/2, the moment in the discrete theory defined 
by Eq. (2) necessarily has fewer independent components than its continuous counterpart 
in Eq. (1). But such a reduction remains possible due to linear dependencies even if N > 
(n+l)(n+2)/2. Whenever a moment in a discrete theory has fewer independent components 
than its continuous counterpart, we will say that the moment is incomplete in this discrete 
theory; if it has the same number, we will say that it is complete. 

Since incomplete moments in a discrete model are artifacts without continuous analogs, a 
fundamental problem in discrete kinetic theory is to determine what moments are complete 
for a given finite velocity set C := {cj}: a realistic description by a discrete theory is possible 
only for complete moments. The purpose of this paper is to develop a systematic approach 
to solving this problem. It is based on the observation that the discrete velocity set {c,} is 
not an arbitrary collection of vectors, but is chosen to be as symmetric as possible so that the 
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model can mimic the physical isotropy of the fluid. In particular, two-dimensional models 
are typically constructed so that the discrete velocity set has the symmetry of a square: 
that is, it is invariant under symmetries of two-dimensional £-space that map the set of four 
velocities {(±1,±1)} into itself, and three-dimensional models are typically constructed so 
that the velocity set has the symmetry of a cube: that is, it is invariant under symmetries 
of three-dimensional ^-space that map the analogous set of eight velocities {(±1,±1,±1)} 
into itself. 

It is natural to exploit the symmetry of the configuration of discrete velocities by applying 
the elementary representation theory of finite groups (cf. [14, 15]). Although models can 
and have been constructed case-by-case using elementary methods, group theory offers the 
advantages of a systematic and unified approach. We do not claim that it results in a ‘better’ 
way to construct models, in the sense of being faster, easier to formulate, or even easier to 
understand. We only contend that it is a natural approach that reveals some problems 
common to constructing all discrete models, which can be hidden by lengthy algebra, even 
(perhaps especially) if the algebra is done symbolically. We note that group theory has 
also been used to study the lattice-gas cellular automata [16-19] and the lattice Boltzmann 
models [20-23] from a different perspective. 

The content of this paper is limited to the kinematics of the description of moments by 
finite discrete-velocity models; a moment need not be well described dynamically in a model 
in which it is complete: This issue will be discussed briefly at the end of the paper. An 
outline of the paper is as follows. We shall first review elementary group theory and its 
application to simple discrete velocity sets in three dimensions based on the vertices, edges, 
and faces of a cube. The group theoretical analysis will be used to study models D3Q6, 
D3Q13, D3Q15, D3Q19, and D3Q27. (Here, the standard notation DdQq is used to denote 
a q - velocity model in d dimensional space.) Some preliminary discussion of a D3Q51 model 
will be given. We shall also briefly discuss some two-dimensional models. It will be shown 
that expressing the models in terms of irreducible representations (cf. [14, 15, 24]) of the 
the group of symmetries of a cube or a square can help answer many basic questions about 
the kinematics of discrete models. Brief discussions are then given of the role of the choice 
of symmetry group and of the role of higher order moments in discrete hydrodynamics. 
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II. DECOMPOSITION INTO IRREDUCIBLE REPRESENTATIONS IN 3D 


The formulation of lattice Boltzmann models begins with a discrete velocity set C = {c;} 
chosen from a lattice S X Z D with lattice constant S x in continuous D- dimensional velocity 
space In three dimensions, the highest symmetry possible for the set C is the symmetry of a 
cube (cf. [24]). Since a model with any less symmetry cannot be satisfactory, this symmetry 
will be imposed on all velocity sets C at the outset. We will describe this symmetry by 
the group of 24 rotations of the cube. Adding inversions leads to the complete group of 48 
symmetries; however, it will appear that using this larger group does not lead to anything 
essentially new, and that the main ideas can be explained and understood more simply using 
the smaller group. 

The distribution function is a finite sum 

/(*, £, t) := Y M x i *)<*(£ - c *), (3) 

CiSC 

where fi(x,t ) := f(x,Ci,t ) defines the number density of particles with velocity c t . The 
multiple relaxation time formalism of d’Humieres [5, 13, 25] models the collision process 
through the relaxation of moments, which therefore play a central role in the formulation. 
Moments of the distribution function / are defined in terms of polynomials chosen from a 
set 0b (£)} by 

Mj(*,t) = fd£f(x, £, t)pj(£) = Y ( 4 ) 

Ci£C 

Thus, values of moments are determined by linear combinations of rows of the matrix 

Aij = (Pj\ci) :=Pj(ci), (5) 

where the bra-ket notation denotes evaluation of the left-hand member (a polynomial pj) on 
the right-hand member (a point c t ) extended by linearity to linear combinations of velocities 
and polynomials. Note that the moment defined in Eq. (4) can be understood as a weighted 
sum of values of the distribution function /j, with weights Pj(cj). 

The number of linearly independent moments of order n is simply the rank of the matrix 
A in Eq. (5) when pj varies over the homogeneous polynomials of degree n. The rank can 
certainly be found by straightforward linear algebra; however, useful simplifications result 
if A is evaluated after expressing both the velocity set {cj} and the polynomial set 
regarded as bases of vector spaces on which the group of rotations of the cube acts as a group 
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of linear transformations, in bases {cj} and {j5j(£)} consisting of quantities that transform 
by irreducible representations [14, 15, 24] of the group of rotations of the cube. The resulting 
matrix will be denoted by A. The irreducible representations are the representations of lowest 
dimension from which all other representations can be constructed; we refer to elementary 
texts ( e.g ., [14, 15, 24]) for details. Fundamental orthogonality properties [14, 15, 24] imply 
that Aij = (pj\ci) = 0 whenever pj and c, belong to different irreducible representations. 
Thus, A consists of blocks A tJ in which indices i and j vary over vectors transforming by 
the same irreducible representation. These blocks are dn x dn if there are n occurrences of 
an irreducible representation of dimension d; since these blocks are much smaller than the 
original matrix A, the computation of the rank is much simpler. 

The irreducible representations of the group of 24 rotations of the cube are exhibited in 
the following table [14, 15, 24]: 



The * notation will be used henceforth to indicate the additional polynomials obtained by 
cyclic permutation of x , y , and z: we use x, y, and z, or index notation Xi, i € {x, y, z} := 
{1, 2, 3}, as convenient, to denote the components of the particle velocity no ambiguity 
is possible because configuration space x plays no role in this paper. For each representation 
r n , the subscript n indicates its dimension, and a set of n linearly independent polynomials 
is given which transforms irreducibly according to T n . Representations of the same dimen- 
sion are distinguished by primes. Only two of the polynomials listed for T 2 are linearly 
independent. 

A. Discrete velocity sets 

The smallest discrete velocity sets invariant under the group of rotations of the cube are 
formed from the vectors describing the edges E, vertices V, faces F, and the center 0 of a 
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cube. Explicitly, these sets are 


12 edges E {(±1, ±1, 0), (±1, 0, ±1), (0, ±1, ±1)} 

8 vertices V {(±1, ±1, ±1)} 

6 faces F {(±1, 0, 0), (0, ±1, 0), (0, 0, ±1)} 

1 center 0 {(0, 0, 0)} 

where, in the interest of simplicity, the lattice constant S x has been set to one. We consider 
these vectors as bases of vector spaces on which the group of rotations of the cnbe acts as a 
group of linear transformation and will also denote these representations by E, V, F, and 0. 
Routine calculations [14, 15, 24] give the decompositions into irreducible representations 


Ti © T 2 © 2Tg © Tg, 

(8a) 

Tx © r; © r 3 © r^, 

(8b) 

rx©r 2 ©r', 

(8c) 

ri 

(8d) 


The explicit linear combinations of velocities that occur in these decompositions are listed 
in Appendix A. 

The meaning of these decompositions is very simple. Consider, for example, the decom- 
position of F: if we have any linear combination of these velocities, say X^eF a i c n i n terms 
of the basis vectors given in Eq. (Al), which we write as c 1 , cf, c 2 , cf, c|, c|, we have 

ciiCi = a 1 c 1 + al&l + a\c 2 2 + afcf + a\c\ + cigCg. (9) 

Ci£ F 

Whereas arbitrary rotations of the sphere mix all of the coefficients a*, a 1 is invariant under 
all rotations of the cnbe, the af , i = 1, 2, 3 transform among themselves according to the 
irreducible representation Tg, and the af transform according to T 2 . 

The absence of the representation Tg in the decomposition of F in Eq. (8c) suggests 
that the three polynomials *{xy} that transform among themselves by Tg according to 
Eq. (6), must vanish on the set F. Thus, this easily verified property has a group-theoretic 
significance. Similarly, the absence of the representation T 2 in the decomposition of V 
implies that *{x 2 — y 2 } vanish on V. Although these results are both obvious, later results 
will demonstrate that group theory can reveal much less obvious linear relations. 
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Turning next to the velocity sets that are commonly used to construct LBE models, let 
us consider the D3Q13 [26], D3Q15, D3Q19, and D3Q27 models. The decompositions into 
irreducible representations of the representations of the group of rotations of the cube acting 
on the vector spaces generated by these velocity sets are perhaps best given in a table, which 
is easily obtained from Eqs. (8): 

model velocity set decomposition 

D3Q13 E U 0 2Ti © T 2 © 2 T 3 © T' 3 
D3Q15 Fuvuo 3T! © Ti © r 2 © r 3 © 2T 3 

( 10 ) 

D3Q19 F U E U 0 3Tx © 2T 2 © 2 T 3 © 2 V' 3 

D3Q21 E U V U 0 3Tx © r; © T 2 © 3 T 3 © 2T' 3 

D3Q27 E U V U F U 0 4Ti © r; © 2T 2 © 3 T 3 © 3 T' 3 

The theoretically possible model D3Q21 is given in the interest of completeness. 

B. Polynomials 

We next consider the polynomials that generate the moments. The rotations of 

the cube form a group of linear transformations of the continuous vector variable and 
by obvious extension, a group of linear transformations of homogeneous polynomials in the 
components of We will again require the decomposition of these representations into 
irreducible representations. 

Denote by P n the set of all homogeneous polynomials in (x, y, z ) of degree n. It is obvious 
that any constant P° is a rotational invariant and therefore transforms as T^ According 
to Eq. (6), linear polynomials P 1 transform irreducibly as T 3 . For quadratic polynomials, a 
new possibility arises: any quadratic polynomial is a linear combination of 

r 2 = x 2 + y 2 + z 2 (11) 

an invariant (also of the group of all rotations of space SO3), that transforms as Ti, and a 
remainder. This decomposition also occurs in the continuous case, where it is reflected in 
the occurrence of the (scalar) pressure as the trace of the stress tensor. This decomposition 
can be written as 

P 2 = r 2 P° © P 2 ’ 0 (12) 
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where P 2,0 denotes the set {a^jXiX 3 \akk = 0} of quadratics with a trace-free coefficient matrix. 
According to Eq. (8), the representation of the group of rotations of the cube on P 2,0 splits 
into the sum 

p 2 ’ 0 = r 2 © r 3 ( 13 ) 

so that finally 

P 2 = Ti © r 2 © r 3 . (14) 

For cubic polynomials, we note first that the product of r 2 and a linear polynomial 
evidently transforms by the irreducible representation T 3 . Separating this contribution, we 
obtain an analog of Eq. (12) 

P 3 = r 2 p 1 © p 3 ’ 0 . (15) 

The Erst term corresponds to the possibility of generating a vector from a symmetric third- 
rank tensor ai mn by the contraction a* = 5 mn ai mn . A familiar physical example is the 
generation of the heat flux vector from the stress flux tensor. The remaining 7 polynomials 
P 3,0 define an irreducible representation of S0 3 on the vector space of cubic polynomials 
{aimnXiXmX n \a imn S mn = a imn 5 in = a imn 5 im = 0}. Equations (12) and (15) are simple illus- 
trations of the representation theory of S0 3 as beautifully explained by Weyl [27]. 

The representation of the group of rotations of the cube on P 3,0 splits into the sum of 
irreducible representations 

p 3 - 0 = r; © r 3 © r' 3 , ( 16 ) 

where the representations on the right side occur on the polynomials 

T\ : xyz 

rv {*x(y 2 - z 2 )} (17) 

r(: {*x(2x 2 - 3y 2 - 3 z 2 )} . 

Since this decomposition is less obvious than the simple result for second rank tensors, we 
note that the decomposition in Eq. (16) is found using the character table, and that that 
vectors in Eq. (17) can be constructed systematically using projection operations [14, 15, 24], 
The elementary calculations are not given here. It follows from Eqs. (15) and (16) that 

p 3 = r; © r 3 © 2 r 3 . (is) 

It may be surprising that a cubic polynomial x(y 2 — z 2 ) appears in a representation T 3 
corresponding to a second rank tensor. This circumstance can perhaps be explained by a 



simple table as follows: 

x y z yz zx xy 
—x z y yz —yx —xz 
The first three columns represent the symmetry operation (x, y, z) — > (—x, z, y). The second 
three columns show the corresponding transformation of the three variables *(yz): compar- 
ing these two lines shows that the irreducible representations r' 3 and r 3 ‘represent’ this 
symmetry operation by distinct transformations. The final three columns exhibit the trans- 
formation of the quantities *{x(y 2 — z 2 )}: they obviously transform like the variables *{yz}, 
that is, by T 3 rather than by T 3 . In the complete group of 48 symmetries of the cube, 
these two occurrences of T 3 would split into two representations with opposite parity under 
inversion. This point will be discussed further later in the paper. 

For homogeneous quartic polynomials 

P 4 = r 4 p° © r 2 P 2,0 © P 4 ’ 0 (20) 

For the group of rotations of the cube, 

p 4 ’ 0 = r 4 © r 2 © r 3 © r' 3 (21) 

where the representations on the right side occur on the polynomials 

r i: {/ 4 } 

F 2 : {*3(x 4 'r- Qx 2 y 2 + y 4 ) — 2J 4 } 

r': {*xy(x 2 -y 2 )} 

r 3 : {*yz( 6x 2 - y 2 - z 2 )} 

where J 4 := ( x 4 + y 4 + z A ) — 3 (x 2 y 2 + y 2 z 2 + z 2 x 2 ). 

To summarize: we begin with the decompositions given by Eqs. (12), (15), and (20) of 
the homogeneous polynomials P 2 , P 3 , and P 4 of degrees 2, 3, and 4 into multiples of powers 
of invariant r 2 , and the remaining polynomials P 2,0 , P 3,0 , and P 4,0 that are not multiples 
of powers of r 2 . The representations of S0 3 on the vector spaces P 2,0 , P 3,0 , and P 4,0 are 
well-known to be irreducible [27], but the representations of the group of rotations of the 
cube on these spaces are reducible, and their decompositions into irreducible representations 
are given as Eqs. (13), (16), and (21), in terms of the explicit polynomial sets defined in 
Eqs. (6), (17), and (22). The reducibility of these representations explains the possibility of 
incomplete moments; this connection will be developed in the next section. 


x(y 2 — z 2 ) y(z 2 — x 2 ) z(x 2 — y 2 ) 

x{y 2 — z 2 ) —z(x 2 — y 2 ) —y{z 2 — x 2 ) 
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III. THE MATRIX A CONSTRUCTION OF MODELS 


In Sec. II A, a basis {q} of the discrete velocity space C is constructed in which the 
basis elements belong to irreducible representations of the group of rotations of the cube; 
the corresponding basis of polynomials {pj} is constructed in Sec. II B. The velocities and 
polynomials are now combined by evaluating the matrix A using these bases; we recall that 
the result will be denoted by A and that the justification for introducing these bases is that 
all entries of A vanish unless {c,} and {pj} belong to the same irreducible representation. 

The orthogonality properties of irreducible representations imply another simple but use- 
ful conclusion: assume that the set of velocities C has been chosen and that the corresponding 
representation admits the decomposition into irreducible representations 

C = niT i © n\Y\ © n 2 T 2 © n 3 T 3 © n' 3 T' 3 . (23) 

In order that A have full rank, it is necessary that representation on the polynomial set P 
admits exactly the same decomposition 

P = ri\T i © n\ T) © n 2 T 2 © n 3 T 3 © n 3 r' 3 . (24) 

Equations (23) and (24) refine the obvious condition that the velocity and polynomial sets 
must have the same dimension 

dim C = dim P = n\ + n\ + 2 n 2 + 3n 3 + 3 n' 3 . 

The condition is only necessary, because nothing prevents the vanishing of a block (cj|p.j); 
the rank of these blocks also must be checked. The process is best explained by examples. 

A. The D3Q6 model 

The simplest discrete model is Broadwell’s original model with six velocities [28] based 
on the faces of a cube. Given the velocity set F from Eq. (8), the problem is to choose 
polynomials to generate appropriate moments. This choice will be exhibited in tabular form 
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as follows: 



Ti 

r; 

r 2 

r 3 

r' 

1 3 

D3Q6 

1 

0 

i 

0 

1 

P° 

1 

0 

0 

0 

0 

P 1 

0 

0 

0 

0 

i 

p2,0 

0 

0 

i 

i 

0 


( 25 ) 


The first row, labeled ‘D3Q6,’ shows the multiplicities of the irreducible representations for 
the velocity set F. The decompositions of the representations on polynomials of degrees 0, 
1, and 2 are given on the next lines. But it is understood that P° can be any scalar r 2n 
and P 1 can be any vector r 2n {*x}, therefore the next line corresponds to trace-free second 
rank tensors as in Eq. (12). This convention will also apply later to tensors of higher rank. 
Each row represents a complete moment, so that the goal is to choose entire rows as nearly 
as possible to construct the model. 

Comparison of the first row with the others shows immediately that the model must 
contain contributions from each row; however, the complete trial set P° © P\ © Pf , corre- 
sponding to a scalar, a vector, and a trace- free second-rank tensor, has dimension 9. The 
explanation is that, as noted earlier, the quadratic polynomials that transform as T 3 , *{xy} 
vanish identically on the set F. We cannot include the complete polynomials P 2,0 to form 
the model, but are forced instead to select only the occurrence of T 2 . The model based on 
D3Q6 therefore necessarily contains an incomplete second order moment [31]. 

The set of polynomials corresponding to the velocity set F must be 


D3Q6 { 


T i 
V 

1 3 

r 2 


from P° : {1} 
from P 1 : {*a;} 
from P 2,0 : {*(x 2 


y 2 )}. 


(26) 


It remains to verify that the polynomials actually arc linearly independent over the discrete 
velocity set. In this case, the verification amounts to showing that no polynomial set vanishes 
identically on the set of points that transforms by the same irreducible representation. The 
trivial verification is omitted. 
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B. The D3Q15 model 


The table corresponding to Eq. (25) is 



Ti 

r; 

r 2 

r 3 

V 

1 3 

D3Q15 

3 

i 

i 

i 

2 

P° 

1 

0 

0 

0 

0 

P 1 

0 

0 

0 

0 

1 

p2,0 

0 

0 

i 

i 

0 

p3,0 

0 

1 

0 

i 

1 


P 3,0 mus t be included in order to accommodate the occurrence of T) in D3Q15. However, 
the table immediately shows that the moment P 3,0 , a pair-trace- free tensor of rank 3, cannot 
be complete, because it will generate a redundant occurrence of T 3 . As in the D3Q6 model, 
this issue can be identified by simply computing dimensions; the group theory analysis 
refines this observation by showing that a model based on the set D3Q15 must contain an 
incomplete third order moment. A polynomial set that generates the required irreducible 
representations is 

'3T i: {l}, {r 2 }, {r 4 }, 

2r 3 : {*&}, {*xr 2 }, 

D3Q15 T 2 : {*(x 2 ^y 2 )}, (28) 

r 3 : {*xy}, 
k r i : {xyz} ■ 

The table of representations again suggests the degeneracies that must occur in this 
model. We have seen that the complete cubic moment generates a redundant occurrence 
of T 3 , and indeed, the cubics that transform as T 3 , given in Eq. (17) as {*x(y 2 — z 2 )}, all 
vanish identically on the velocity set D3Q15. The remaining cubics *x{2x 2 — 3 y 2 — 3z 2 ) that 
transform as T 3 , prove to be linearly dependent on the polynomials selected in Eq. (28), but 
we omit the simple verification. 

We must again verify that these polynomials are linearly independent over the discrete set 
of velocities F U V U 0 that defines this model. For the irreducible representations that only 
occur once, it is sufficient to verify that the polynomials do not vanish identically. In this 
case, these representations are T 2 and T 3 , corresponding to quadratic polynomials. We omit 
the easy verification. A nontrivial problem arises only for the irreducible representations that 
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occur with multiplicity greater than one. Let us verify directly that the three polynomials 
that transform according to r\ are linearly independent in this model. LIsing the results of 
Appendix A, the identity representation occurs on the center of the cube (the zero vector) 
and on |^ c . eF c * and | S Ci ev c *- Evaluating the polynomials 1, r 2 , and r 4 on these three 
velocity vectors gives the matrix 


1 0 0 
111 
1 3 9 


(29) 


Since this matrix is nonsingular, the required linear independence is demonstrated. A similar 
argument applies to the two occurrences of the representation r' 3 and establishes that the 
polynomials in Eq. (28) are indeed linearly independent over the velocity set D3Q15. 

The distribution function of this model is the finite sum 


/(*, t) = ( 3 °) 

CiSFUVUO 

We have verified that the following nonvanishing linearly independent moments are possible 
in this model: 

P = (1| f)t (31a) 

e = <r 2 |/>, (31b) 

£ = (r 4 |/), (31c) 

3 = (31d) 

q = (*xr 2 \f), (31e) 

p = (*(a; 2 - p 2 ), * X y\f ), (31f) 

T = (xyz\f). (31g) 


The scalar moments are the mass density p, a quantity e formally related to the internal 
energy, and a fourth order moment e. The vector moments are the momentum j and the 
vector q related to the energy flux. One second rank tensor moment exists, the momentum 
flux, or stress p. All of these moments are complete. 

Again, we recall that in the Introduction we stated the restriction of this analysis to 
kinematics. By stating that the model contains the energy-flux related vector q, we only 
assert that q is a contracted third-rank tensor that transforms properly as a vector; we do 
not assert that the D3Q15 model correctly models the heat flux. 
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C. The D3Q13 and D3Q19 models 


Without presenting the straightforward details, we note the moments in the D3Q13 
model. 


p = <ll/>, 

(32a) 

e = (r 2 \f), 

(32b) 

j = (*x\f), 

(32c) 

P = (*(x 2 -y 2 ), *xy\f ), 

(32d) 

T = {*x{y 2 -z 2 )\ f) t 

(32e) 

where the distribution function is 

/(*, £,t)= fifaWiZ - c *)- 

(33) 

cieEuO 

The moment T is an incomplete third-rank tensor. 
For the D3Q19 model, the moments are 

P = (l|/)> 

(34a) 

e = (r 2 |/), 

(34b) 

£ = {r 4 \f), 

(34c) 

j = (*x| /), 

(34d) 

q = (*xr 2 \f), 

(34e) 

p = <*(o: 2 — ?/ 2 ), *xy\f), 

(34f) 

e = (*( x 2 - y 2 )r 2 , *xyr 2 \f). 

(34g) 

where the distribution function is 

f(x,£,t)= V fi(x,t)6(£-Ci). 

(35) 

CiGFUEUO 

In this model, the flux of q is the complete second-rank tensor e. 


Whereas the D3Q13 and D3Q15 models both contain incomplete moments, all moments 
in the D3Q19 model are complete. This model is also observed to be numerically more stable 
than the D3Q15 model [29], This suggests a possible connection between completeness of 
moments and numerical stability that may warrant further investigation, although at this 
point, such a connection is entirely conjectural. 
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D. The D3Q27 model 


We will not repeat the previous tabular procedure for choosing the polynomials: we 
merely recall from Eq. (10) that the points of the D3Q27 model decompose into 4r\ © © 

2r 2 © 3r 3 © 3T' 3 . Consider the candidate polynomials 

4Ti : {1}, {r 2 }, {r 4 }, {r 6 }, 

E'l ; {xyz}, 

2F 2 : {*(x 2 -y 2 )}, {*(x 2 -y 2 )r 2 }, (36) 

3r s : {*xy}, {*xyr 2 }, { *x(y 2 - z 2 )}, 

3T 3 : {*a;}, {*xr 2 }, {*x(2x 2 — 3 y 2 — 3z 2 )}. 

In this case, the moments are not linearly independent, although this is hardly obvious from 
the formulas themselves. The degeneracy proves to occur in the three occurrences of T 3 . As 
in the analysis of the D3Q15 model, we must evaluate the nine polynomials {*x}, {*xr 2 }, 
{*x(2x 2 — 3 y 2 — 3z 2 )} on the nine velocity vectors 


= IV 
6 2-/ 


Ci£ F 


©a © 1 


fj — 1 V C 


1 


c a 8 2—* 


CiSE C iot c ii 


a 


= 1, 2, 3, 


on which T 3 occurs. We simply state the result of the calculation 


(xp\c a ) 

(r 2 xp\c a ) 

(xp(2xp 

— 3 r 2 

OXp +1 

-3x 2 0+2 )\c a ) 


213x3 

213x3 

413x3 


^ 2 Xy\S a ) 

(xp{2xp 

— 3r 2 
ox /3+l 

- 3x 2 0+2 )\c' a ) 

= 

813x3 

24I 3x3 

— 32I 3x3 

(xpK) 

{r 2 xp\ c") 

(xp(2xp - 

- 3r 2 

oc i/ 3+1 

~ 3^ +2 )|c") _ 


813x3 

16I 3 x3 

— 81.3x3 


(37) 


Since 


det 


2 2 4 

8 24 -32 
8 16 -8 


0, 


(38) 


we see that the three polynomials which transform as T 3 are not linearly independent on 
the set of velocities chosen. 

Lallemand [8] observed that the linear independence could be restored sim- 
ply by replacing the velocities corresponding to the faces by the vectors F* = 
{(±2, 0, 0), (0, ±2, 0), (0, 0, ±2)}. A routine calculation shows that the polynomials which 
transform as T 3 are indeed linearly independent over this set and that in fact all the moments 
defined by these polynomials are indeed independent. 
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This model therefore contains the following linearly independent moments: 


P = <1| /), (39a) 

e = (r 2 |/), (39b) 

ei = (r 4 \ /), (39c) 

£2 = (r 6 |/), (39d) 

j = (*x\f), (39e) 

q = ( *xr 2 \f ), (39f) 

p = (*(a; 2 -y 2 ), *xy\f ), (39g) 

e = (*(z 2 -y 2 )r 2 , *xyr 2 \f), (39h) 

T = (xyz, *x(y 2 — z 2 ), *x(2x 2 — 3y 2 — 3z 2 )\f). (39i) 

where the distribution function is 

/(*,£,*)= J] fi(x,t)5(£ - Ci) (40) 

Ci£2FUEUVUO 


In this model, a fourth scalar £2 exists, and the third rank tensor T is complete. Eqs. (20) 
and (21) show that the set of all quartics decomposes into irreducible representations as 
P 4 = 41b © © 3T 2 © 4T 3 © 4Tg and contains excess occurrences of T 3 and r' 3 . We observe 

that the three polynomials *xy(x 2 — y 2 ) that transform as Tg (compare Eq. (22)) vanish on 
all velocities D3Q27. It is straightforward to obtain the linear dependencies between the 
quartic velocities {*yz(6x 2 — y 2 — z 2 )} and the velocities of the D3Q27 model. 

IV. A POSSIBLE HIGHER ORDER MODEL D3Q51 

We next consider a theoretically possible higher order model. We noted that the quartics 
*xy(x 2 — y 2 ) vanish on the discrete velocity sets based on the edges, vertices, faces, and 
center; therefore, in any model based on these sets or their multiples, fourth rank tensors 
cannot be complete. To obtain complete fourth rank tensors, we need a different kind of 
velocity set. 

A general vector has 24 distinct images under the 24 rotations of the cube; the 
edges, faces, and vertices have fewer because they are invariant under special rota- 
tions. In order to avoid the linear dependencies of the special quartic polynomials, let 
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us add the 24 velocities obtained as the transforms of (2, 1, 0). This set, containing 
the velocities with the smallest energy beyond the D3Q27 model, is denoted as G = 
{(± 2 , ± 1 , 0 ), (± 1 , ± 2 , 0 ), (± 2 , 0 , ± 1 ), (± 1 , 0 , ± 2 ), ( 0 , ± 2 , ± 1 ), ( 0 , ± 1 , ± 2 )}. 

The representation of the group of rotations of the cube on this set decomposes into the 
irreducible representations 


g = Ti © r; © 2 r 2 © 3 r 3 © 3r 3 . (4i) 

The representation on any set of 24 points obtained as the distinct images of one lattice 
point will always admit the same decomposition into irreducible representations as Eq. (41): 
this is the ‘regular representation’ of group theory. 

Let us consider the discrete velocity set of the D3Q27 model augmented by this set, 
giving the velocity set D3Q51 = OUFUVUEUG. The representation on this velocity set 
decomposes into irreducible representations as 

O © F © V © E © G = 5Ti © 2T) © 4T 2 © 6T 3 © 6T 3 . (42) 

We again exhibit the choice of polynomials in tabular form: 



Ti 

r; 

r 2 

r 3 

V' 
1 3 

D3Q51 

5 

2 

4 

6 

6 

P° 

1 

0 

0 

0 

0 

P 1 

0 

0 

0 

0 

1 

p 2,0 

0 

0 

1 

1 

0 

p3,0 

0 

1 

0 

1 

1 

p4,0 

1 

0 

1 

1 

1 

p 5,0 

0 

0 

1 

1 

2 

p 6,0 

1 

1 

1 

2 

1 


A trial set of polynomials can be constructed using polynomials up to degree 5, 5 P° © 
2 P 1 © 2 P 2,0 © 2 P 3,0 © P 4,0 © P 5,0 where multiple occurrences of P°, P 1 , P 2,0 , and P 3,0 
are obtained from sets like r 2 P° and r 2 P l . The table shows that the decomposition into 
irreducible representations for this polynomial set is 5Ti © 2T / 1 © 4T 2 © 6T 3 © 6T 3 , which 
coincides with the decomposition of the velocity set. However, these polynomials are not 
linearly independent over the velocity set D3Q51. The problem is with the representation 
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r;, which we see can only occur in P 3,0 ; to obtain two occurrences of T^, we will also require 
the polynomials r 2 P 3,0 so that E, will occur on the polynomials xyz and r 2 xyz. But both 
vanish on the sets G, F, and E, and they coincide on V. It follows that xyz and r 2 xyz are 
not linearly independent on D3Q51, and the dimension of the polynomial set is in fact no 
more than 50. 

We can try to solve the problem by using polynomials of degree 6, for which a second 
representation E, appears. Explicitly, it is on the polynomial 

x y [x — y ) + y z (y — z ) + z x (z — x ) 

which obviously does not vanish on the set G. This polynomial, and xyz give two independent 
polynomials that transform by E, . However, the selection of the remaining polynomials is 
not straightforward: the trial set 

5P° © P 1 © P 2 ’ 0 © P 3 ’ 0 © P 4 ’ 0 © P 5 ’ 0 © P 6 ’ 0 

has the same decomposition into irreducible representations as the velocity set D3Q51, but 
the appearance of only a single P 1 means that a contracted tensor of the form r 2 P*, which 
is needed to represent the heat flux, does not appear. On the other hand, returning to 
the previous trial set but replacing r 2 xyz with the sixth degree polynomial noted above 
will create an incomplete third rank tensor. While this example underscores some of the 
difficulty of constructing higher dimensional discrete models, it also shows how group theory 
can help identify problems relatively quickly. 


V. TWO-DIMENSIONAL MODELS 

To treat two-dimensional models by the group theoretic approach, the symmetry group of 
the cube is replaced by a symmetry group of the square. It will be taken to be the group of 
eight transformations: the four 90° rotations, and the four reflections through the diagonals 
and the bisectors of opposite sides. This group is larger than the group of four rotations of 
the square, and is chosen to provide as many representations as possible. The choice of the 
symmetry group will be discussed further in the next section. 
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The irreducible representations are 


( 44 ) 


The simplest sets of discrete velocities invariant under this symmetry group are formed from 
the faces and vertices of the square, to which we add as before the center, 

F = {( 1 , 0 ), ( 0 , 1 ), (- 1 , 0 ), ( 0 , - 1 )}, 

V = {( 1 , 1 ), (- 1 , 1 ), (- 1 , - 1 ), ( 1 ,- 1 )}, 

0 = {( 0 , 0 )}. 

The corresponding representations decompose into irreducible representations as 

f = ri©r 2 ©ri, 
v = ^©^©r", 

0 = Tl 

As in the symmetry group of the cube, the representation of the continuous rotation group 
on trace-free second rank tensors, given as the representation on quadratics {( x 2 — y 2 ), 2 xy} 
splits into r'[ © T". To describe a second rank tensor completely, both representations are 
needed. 

The simplest model in which a second rank tensor is complete D2Q9, defined by the set 
F U V U 0. Since the representation on these velocities decomposes into 

F © V © 0 = 3Ti © 2T 2 © Ti © T", (45) 

we choose candidate polynomials belonging to the same representations, 

3Ti : {1}, {r 2 }, {r 4 }, 

2 T 2 : {x,y}, {xr 2 , yr 2 }, 

tV 2 2 

T{ : x -y , 

■p// 

T{ : xy. 
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These moments are easily shown to be linearly independent over the defining velocity set; 
accordingly, this 9-velocity model describes the following moments: 


p = 


(46a) 

e = 

<r 2 |/>, 

(46b) 

O 

<r 4 |/>, 

(46c) 

.1 = 

(■ x,y\f ), 

(46d) 

Q = 

(r 2 x,r 2 y\f), 

(46e) 

P = 

( x 2 y 2 , xy\f). 

(46f) 


To obtain a complete third rank tensor, we can add the velocities F* = 
{(2, 0), (0, 2), (—2, 0), (0, —2)} resulting in a model D2Q13. The representation on the 
velocity set FU2FUVUO decomposes into 

F © 2F © V © 0 = 4Ti © 3T 2 © 2^ © T". (47) 


The polynomial set 

4T© {l},{r 2 },{r 4 }, {r 6 }, 

3 T 2 : {x,y}, { xr 2 , yr 2 }, {x(x 2 - 3 y 2 ), y(3x 2 - y 2 )}, 

2T\: ( x 2 -y 2 ),(x 2 -y 2 )r 2 , 

T": xy, 

is easily shown to be linearly independent over the chosen finite velocity space. 

Let us briefly consider the formulation of higher order models. Eight more velocities 
can be added to F, V, and 0, either as the set F* U V* = {±2, 0), (0, ±2), (±2, ±2)}, or, 
following the D3Q51 model, as the set G = {(±2, ±1), (±1,±2)}. The first set leads to a 
17-vclocity model in 2D, which like D2Q9, cannot describe a complete fourth rank tensor: 
the polynomial xy(x 2 — y 2 ) still vanishes on all of the discrete velocities. On the other hand, 
the representation on G decomposes as G = Ti © T^ © T" © T'" © 2T 2 . The resulting D2Q17 
model contains a complete fourth rank tensor, but we do not present the details, which 
should now be obvious. 
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VI. THE CHOICE OF THE SYMMETRY GROUP 


In this paper, the only role of the symmetry group of the velocity set is to help simplify 
the calculation of the matrix A; no particular physical importance is attached to it. Thus, 
the group of rotations of a cube was chosen simply for ease of exposition. It might seem 
physically more natural to choose the group of 48 symmetries that includes the inversions 
(. x,y,z ) — > (—x,—y,—z). The representation theory of this group yields two irreducible 
representations with opposite parity under inversions for every irreducible representation of 
the group of 24 rotations: one defined by even order polynomials, and the other defined by 
odd order polynomials. But the orthogonality properties of irreducible representations are 
all that we require; since polynomials of opposite parity are automatically orthogonal, no 
additional simplifications would result from explicitly introducing the group of 48 symme- 
tries. 

The situation is quite different for the two-dimensional models. If we had chosen the 
group of four rotations of a square as the basic group, there would only be four irreducible 
representations. By choosing a larger group with more irreducible representations, we can 
increase the number of vanishing elements in the matrix A thereby lightening the algebra. 

VII. HIGHER ORDER MOMENTS IN LBE MODELS 

In the usual hydrodynamics described by the Navier-Stokes equations, the highest rank 
tensor involved is two; the third rank stress flux is reduced by index contraction to the 
heat flux vector q. But a generalized hydrodynamics model, such as Grad’s 13-moment 
model [30], might attempt to model the complete stress flux. In this case, the model should 
contain complete moments up to order at least three. But since the advection operator 
couples moments to their fluxes, which are of order one greater, a model of the stress flux 
should contain complete tensors of ranks up to four. More generally, for the linearized 
Boltzmann equation or the Maxwell molecules, moments must be complete at least to order 
N + 1 for a dynamically realistic model of moments of order N. Modeling of higher order 
moments could be of interest for LBE simulations of certain special cases of finite Knudsen 
number flows. 

It must be emphasized that we are only interested in the linearized Boltzmann equation, 
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on which the multiple relaxation time formalism, and indeed most other lattice Boltzmann 
models, are based; therefore, higher order moments generated by the nonlinear collision 
operator are not considered. 


VIII. CONCLUSIONS 

The representation theory of finite groups has been applied to the systematic construction 
of Lattice Boltzmann models. Given the choice of a finite velocity set {c*}, the method helps 
identify the moments for which a kinematically satisfactory description is possible. While 
these moments can be identified by elementary means, group theory simplifies the calcula- 
tions by introducing natural vector space bases in which the calculations are particularly 
simple. 

By increasing the dimension of the space of moments, adding more velocities obviously 
makes complete moments of higher order possible. Thus, in three dimensions, the Broadwell 
model based on six velocities contains an incomplete second rank tensor; in the D3Q15 and 
D3Q19 models, the second rank tensors are complete but a third rank tensor is incomplete; 
in the D3Q27 model, the lowest rank of an incomplete tensor is four. A similar progression 
occurred for the two-dimensional models. We used group theory to determine exactly which 
moments are complete; this may not be obvious from the velocity set itself. Some of the 
difficulties in choosing discrete velocities to achieve complete moments of a given order were 
discussed in Sec. IV. 

We can compare the present approach with a straightforward orthogonalization procedure 
applied directly to the velocities. It is evident that the results of the group-theory selection 
of polynomials could be reproduced if one happened to make the appropriate choices in the 
orthogonalization. Group theory offers an advantage when the model is extended by adding 
new velocities, for whereas orthogonalization must be repeated from the beginning over the 
new velocity set, group theory makes it easy to generate polynomials that correspond to the 
irreducible representations introduced by the new velocities. 

Finally, we should remark on a limitation of group theory, at least on the level discussed 
in this paper: analysis of the model in the method of Lallcmand also requires that we 
compute the dispersion relation of waves in the finite wavenumber hydrodynamics [5, 8, 9]. 
In effect, this paper accomplishes this analysis only in the limit of zero wavenumber. The 
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analysis for finite wavenumbers remains difficult, although perhaps a more sophisticated 
application of group theory might be useful in that problem as well. The finite wavenumber 
analysis can couple the lower and higher order moments; in this case, anisotropy of wave 
dispersion is possible if the higher order moments are incomplete. Thus, incomplete higher 
order moments can have consequences even for models that are restricted to Navier-Stokes 
hydrodynamics. 

APPENDIX A: SYMMETRY GROUP OF THE CUBE 

This appendix lists the decompositions into irreducible representations of the represen- 
tations of the symmetry group of the cube on the faces, edges, and vertices. 

Denote the vectors corresponding to the faces of the cube as C\ = (1, 0, 0), c 2 = 
(— 1, 0, 0), c 3 = (0, 1, 0), c 4 = (0, —1, 0), c 5 = (0, 0, 1), and c 6 = (0, 0, —1). The de- 
composition into irreducible representations is given by the linear combinations 



1-10011 

1-10000 


r 3 0 0 1 -1 0 0 
00001-1 

The entry corresponding to r' 3 means that the three linear combinations (c 4 — c 2 ), (c 3 — c 4 ), 
(c 5 — c 6 ) transform like a vector under the symmetry group of the cube. Note that the three 
linear combinations listed as transforming as T 2 are linearly dependent. 

The linear combinations are of the form Xa<j<6lb'( c *) c ?:, where the pj are polynomials 
transforming irreducibly as Ti, T 2 , and T 3 . In Eq. (Al), these polynomials are, respectively, 
{1}, {*(x 2 -y 2 )}, and {*a;}. 

Next, write the vectors corresponding to the eight vertices as c 4 = (1, 1, 1), c 2 = 
(1, 1, -1), c 3 = (1, -1, 1), c 4 = (-1, 1, 1), c 5 = (1, -1, -1), c 6 = (-1, 1, -1), 
c 7 = (—1, —1, 1), and c 8 = (—1, —1, —1). The decomposition into irreducible represen- 
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tations is given by the linear combinations 


V 

Cl 

C 2 

C 3 

c 4 

C 5 

C 6 

C 7 

C 8 

Ti 

1 

1 

1 

1 

1 

1 

1 

1 

r; 

1 

1 

-1 

-1 

1 

1 

1 

1 


1 

1 

-1 

-1 

-1 

-1 

1 

1 

r 3 

1 

-1 

-1 

1 

1 

-1 

-1 

1 


1 

-1 

1 

-1 

-1 

1 

-1 

1 


1 

1 

1 

-1 

1 

-1 

-1 

-1 

V' 

1 3 

1 

1 

-1 

1 

-1 

1 

-1 

-1 


1 

-1 

1 

1 

-1 

-1 

1 

-1 


(A2) 


Again, this table is written more succinctly as the linear combinations Yh<i<sPj( c i) c i where 
the pj are polynomials {1}, {xyz}, {*xy}, and 

Finally, denote the vectors corresponding to the edges as: C\ = (1, 1, 0), c 2 = (—1, 1, 0), 
c 3 = (-1, -1, 0), c 4 = (1, -1, 0), c 5 = (0, 1, 1), c 6 = (0, -1, 1), c 7 = (0, -1, -1), 
c 8 = (0, 1, -1), Cg = (1, 0, 1), c 10 = (-1, 0, 1), Cn = (-1, 0, -1), and c 12 = (1, 0, -1). 
The decomposition is 


E 

Cl 

c 2 

c 3 

c 4 

C .5 

c 6 

C 7 

c 8 

c 9 

Cio 

Cn 

c i2 

Ti 

i 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

r 2 

2 

2 

2 

2 

-1 

-1 

-1 

-1 

-1 

-1 

-1 

-1 


-1 

-1 

-1 

-1 

2 

2 

2 

2 

-1 

-1 

-1 

-1 


-1 

-1 

-1 

-1 

-1 

-1 

-1 

-1 

2 

2 

2 

2 


0 

0 

0 

0 

1 

1 

-1 

-1 

1 

1 

-1 

-1 

1 3 

1 

1 

-1 

-1 

1 

-1 

-1 

1 

0 

0 

0 

0 


1 

-1 

-1 

1 

0 

0 

0 

0 

1 

-1 

-1 

1 


0 

0 

0 

0 

1 

-1 

1 

-1 

0 

0 

0 

0 

r 3 

0 

0 

0 

0 

0 

0 

0 

0 

1 

-1 

1 

-1 


1 

-1 

1 

-1 

0 

0 

0 

0 

0 

0 

0 

0 


1 

1 

1 

1 

0 

0 

0 

0 

-1 

-1 

-1 

-1 

r 3 

-1 

-1 

-1 

-1 

1 

1 

1 

1 

0 

0 

0 

0 


0 

0 

0 

0 

-1 

-1 

-1 

-1 

1 

1 

1 

1 


(A3) 
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These linear combinations are Xa<i<i 2 Pi( c *) c * w h ere the pj are respectively {1} (Ti), 

{*(x 2 - y 2 )} (r 2 ), {*x} (r 3 ), {* xy } (r 3 ), and {**( y 2 - z 2 )} (r 3 ). 
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